Fast Approximate Dynamic Programming for Input-Affine Dynamics

نویسندگان

چکیده

We propose two novel numerical schemes for the approximate implementation of dynamic programming (DP) operation concerned with finite-horizon optimal control discrete-time systems input-affine dynamics. The proposed algorithms involve discretization state and input spaces are based on an alternative path that solves dual problem corresponding to DP operation. provide error bounds algorithms, along a detailed analysis their computational complexity. In particular, specific class problems separable data in variables, approach can reduce typical time complexity from $\mathcal {O}(XU)$ {O}(X+U)$ , where notation="LaTeX">$X$ notation="LaTeX">$U$ denote size discrete spaces, respectively. This reduction is achieved by algorithmic transformation minimization addition via conjugation.

برای دانلود رایگان متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Approximate dynamic programming with affine ADDs

context-specific additive multiplicative ! " # # ! # ! " # $ # #% "& #% "&

متن کامل

Fast Approximate Quadratic Programming for Graph Matching

Quadratic assignment problems arise in a wide variety of domains, spanning operations research, graph theory, computer vision, and neuroscience, to name a few. The graph matching problem is a special case of the quadratic assignment problem, and graph matching is increasingly important as graph-valued data is becoming more prominent. With the aim of efficiently and accurately matching the large...

متن کامل

Approximate Dynamic Programming for High-Dimensional Problems

There is a wide range of simulation problems that involve making decisions during the simulation, where we would like to make the best decisions possible, taking into account not only what we know when we make the decision, but also the impact of the decision on the future. Such problems can be formulated as dynamic programs, stochastic programs and optimal control problems, but these technique...

متن کامل

Sparse Approximate Dynamic Programming for Dialog Management

Spoken dialogue management strategy optimization by means of Reinforcement Learning (RL) is now part of the state of the art. Yet, there is still a clear mismatch between the complexity implied by the required naturalness of dialogue systems and the inability of standard RL algorithms to scale up. Another issue is the sparsity of the data available for training in the dialogue domain which can ...

متن کامل

Approximate Dynamic Programming via Linear Programming

The curse of dimensionality gives rise to prohibitive computational requirements that render infeasible the exact solution of largescale stochastic control problems. We study an efficient method based on linear programming for approximating solutions to such problems. The approach "fits" a linear combination of preselected basis functions to the dynamic programming costtogo function. We develop...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

ژورنال

عنوان ژورنال: IEEE Transactions on Automatic Control

سال: 2023

ISSN: ['0018-9286', '1558-2523', '2334-3303']

DOI: https://doi.org/10.1109/tac.2022.3232637